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Abstract 

v 

Renewal  ideas  play  a  fundamental  rule  in  applied  probability.  In 
particular,  renewal  methods  are  powerful  tools  for  dealing  with  the 
asymptotic  behavior  of  the  regenerative  processes  that  are  typical  of 
queueing  and  operations  research  applications.  In  this  paper  we  survey 
the  main  results  of  the  theory  and  develop  some  “smoothed”  versions  of 
the  convergence  theorems.  These  smoothed  versions  typically  have  much 
weaker  associated  regularity  hypotheses  than  the  classical  version.  These 
smoothed  limit  theorems  are  established  under  minimal  conditions  that 
are  essentially  necessary.  ; 
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Donald  L.  Iglehart 
Stanford  University 


1.  INTRODUCTION 

Renewal  ideas  play  a  fundamental  rule  in  applied  probability.  In  partic¬ 
ular,  renewal  methods  are  powerful  tools  for  dealing  with  the  asymptotic 
behavior  of  the  regenerative  processes  that  are  typical  of  queueing  and  op¬ 
erations  research  applications.  In  this  paper  we  survey  the  main  results 
of  the  theory  and  develop  some  “smoothed”  versions  of  the  convergence 
theorems.  These  smoothed  versions  typically  have  much  weaker  associated 
regularity  hypotheses  than  the  classical  version.  In  fact,  these  smoothed 
limit  theorems  are  established  under  minimal  conditions  that  are  essentially 
necessary. 

This  paper  is  organized  as  follows.  Section  2  describes  the  classical  limit 
theory  for  solutions  to  renewal  equations;  Section  3  discusses  the  extensions 
to  equilibrium  processes.  In  Section  4,  a  smoothed  version  of  the  renewal 
theorem  is  described.  It  is  applied  to  equilibrium  processes  in  Section  5. 
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2.  THE  TWO  BASIC  FORMS  OF  THE 
RENEWAL  THEOREM 

In  this  section,  we  review  the  two  basic  forms  of  the  renewal  theorem 
Let  T  be  the  family  of  probability  distribution  functions  F  correspond¬ 
ing  to  non-negative  r.v.’s  which  are  positive  with  positive  probability  (i.e. 
F(0— )  =  0  and  F(0)  <  1).  Given  F  £  !F  and  a  (measurable)  function  b(t) 
which  is  a.e.  finite-valued  (a.e.  with  respect  to  Lebesgue  measure),  the 
renewal  equation  takes  the  form 

(2.1)  a(0  =  6(0+  /  a(t-u)Fidu) 

J[o.t] 

for  a.e.  t  >  0.  The  function  a(  )  appearing  in  (2.1)  is  termed  the  solution 
to  the  renewal  equation  (when  it  exists)  and  the  goal  here  is  to  study  the 
behavior  of  a(t)  as  t  approaches  infinity. 

As  is  usual  in  the  literature,  we  adopt  the  notation  F  *  a  to  denote  the 
convolution  /jg,ja(<  -  u)F(du).  The  renewal  equation  (2.1)  can  then  be 
re-written  symbolically  in  the  form  a  =  6  -f  F  *  a. 

Before  proceeding  to  the  statements  of  the  two  basic  forms  of  the  renewal 
theorem,  we  will  first  give  conditions  under  which  unique  solutions  to  the 
renewal  equation  exist.  Define  B  to  be  the  class  of  Borel  measurable  func¬ 
tions  b  :  [0,  oo)  — •  JR  such  that  sup{|i(s)|  :  0  <  s  <  <}  <  oo  for  all  <  >  0.  In 
other  words,  B  corresponds  to  the  family  of  real-valued  Borel  measurable 
functions  on  [0,oo)  that  are  bounded  on  bounded  intervals.  For  F  G  F,  we 
let  Ur(t)  be  the  function  on  [0,oo)  defined  by 

c/H<)  =  £F('‘)(t), 

n=0 

where  F^"^  is  the  n-fold  convolution  of  F.  The  function  {/;-(<)  is  called  the 
renewal  function  associated  with  F. 

The  following  well-known  theorem  establishes  a  uniqueness-exister'  ’• 
suit  for  solutions  to  the  renewal  equation.  (For  a  proof,  see  p.  184-lbo 
Karlin  smd  Taylor  (1975).) 

(2.2)  Theorem.  If  F  6  F  and  b  £  B,  then  there  exists  a  solution  a  £  B  to 
the  renewal  equation  (2.1).  The  solution  a  is  unique  in  the  class  B  and  is 
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given  by 

(2.3)  a  =  UF*b. 

Furthermore,  the  solution  a  defined  by  (2.3)  satisfies  (2.1)  at  every  <  >  0. 

In  many  applications,  we  can  not  assume  that  either  a  or  6  is  in  the  class 
B.  For  example,  there  may  exist  a  non-empty  Lebesgue  set  of  measure  zero 
on  which  |6(t)|  is  infinite.  To  deal  with  this  situation,  we  can  often  use  the 
next  result.  (See  Glynn  (1988)  for  a  proof.)  Let  C  be  the  class  of  functions 
6  :  [0,oo)  — ►  IR  such  that  /g  |6(s)jds  <  oo  for  all  t  >  0. 

(2.4)  Theorem.  U  F  €  ^  and  b  €  C,  then  there  exists  a  solution  a  €  £  to 
the  renewal  equation  (2.1).  The  solution  a  is  unique  in  the  class  C  (i.e.  if 
Ui,a2  6  ■C  satisfy  (2.1),  then  oj  =  02  a.e.)  and  is  given  hy  a  =  Up  *  b. 

Typically,  the  solution  Up  *  b  to  the  renewal  equation  (2.1)  can  not 
be  computed  explicitly.  However,  the  renewal  theorem  allows  us  to  an¬ 
alyze  the  limiting  behavior  of  the  solution  (Up  *  b){t)  as  <  —  00.  Let 
A  =  (/fQ  define  A  to  equal  zero  if  F  has  infinite  mean. 

Basically,  the  renewal  theorem  provides  conditions  under  which 

(2.5)  iUp*b)it)-^X  [  bis)ds 

Jo 

as  <  — ►  00.  The  two  versions  of  the  renewal  theorem  give  two  different  sets 
of  conditions  for  establishing  the  validity  of  (2.5).  The  first  version  that  we 
shall  discuss  is  known  as  Smith’s  form  of  the  renewal  theorem;  it  imposes 
a  fairly  strong  regularity  hypothesis  on  F  and,  as  a  result,  demands  less 
structure  on  6. 

(2.6)  Theorem.  Suppose  that  F  6  F  and  is  spread-out  (i.e.  for  some 
n>  1,  F(")has  a  non-trivial  absolutely  continuous  component  with  respect 
to  Lebesgue  measure).  If  b  is  bounded,  Lebesgue  integrable  on  [0,oo),  and 
b(t)  — ►  0  as  <  — ►  00,  then  (Up  *  b)(t)  — ►  A  6(s)ds. 

For  a  proof,  see  Smith  (1955,  1960).  Looking  at  the  conditions  on  6, 
the  integrability  hypothesis  is  natural  in  view  of  the  fact  that  the  inte¬ 
gral  /g**  b(8)ds  appears  in  the  limit.  As  for  the  two  other  conditions,  the 
following  examples  show  that  they  are,  in  some  sense,  necessary. 
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(2.7)  Example,  (necessity  of  boundedness):  Suppose  that  5  is  non¬ 
negative,  Lebesgue  integrable  on  [0,oo),  and  b(i)  — ►  0  as  t  —  oo,  but  that 
sup{(6(s)|  :  0  <  s  <  1}  =  oo.  We  will  show  that  there  exists  a  spread-out 
F  £  ^  such  that  (Up  *  b){n)  =  oo  for  n  >  1. 

There  exists  {<„  :  n  >  1}  such  that  0  <  <«  <  1  and  b(t„)  — ►  oo.  By 
picking  a  suitable  subsequence,  we  may  further  assume  that  fc(ln)-2~"  — ♦  oo 
as  n  — ►  00.  Then,  let  B{x)  =  2~*/(i  >  1  —  It)  and  observe  that 

OO 

6(1  -  x)B{dx)  =  Y^2~-b(U)  =  oo. 

t=i 

Now,  let  F{x)  =  2"'(xA  l)-(-  2~'*“^S(x  —  n4- 1)  for  x  >  0;  note  that 

F  is  spread-out.  But 

{UF*b)(n)>  f  6(n-x)F(dx)  >  2-"-*  /  6(1  -  x)B(dx)  =  oo. 


(2.8)  Example,  (necessity  of  b(t)  — *  0  as  <  — ►  oo):  Suppose  that  6  is 

bounded  and  Lebesgue  integrable  on  [0,oo),  but  6(()  0  as  t  — *  oo.  We 

will  show  that  there  exists  a  spread-out  F  £  F  such  that  {U  *  6)(<)  -f* 
A  b{s)ds.  Choose  F{x)  =  1  -exp(-Ai)  for  x  >  0.  Then,  Up{t)  =  1  -|-  At 
(as  may  be  verified  via  Laplace  transforms),  so  that 

{UF*b){t)  =  b(t)+  \  [  b(s)ds. 

Jo 

Since  b(s)ds  — ►  b(s)ds,  it  is  evident  that  b(t)  must  tend  to  zero,  in 

order  that  ((/r  *  6)(t)  converge  to  the  correct  limit. 

More  recently,  the  following  uniform  version  of  Smith’s  theorem  has  been 
obtained  by  Arjas,  Nummelin,  and  Tweedie  (1978). 

(2.9)  Theorem.  Suppose  that  F  £  F  and  is  spread-out.  If  c  is  a  non- 
negative  bounded  Lebesgue  integrable  function  on  [0,<x>),  and  c(t)  — *  0  as 
<  — ►  oo,  then 
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Given  an  operator  H,  the  notation  supn|<e  H{b)  means  sup{//(6)  ;  fc  is  a 
Borel  measurable  function  on  [0,  oo)  such  that  |fc(l)l  <  c(t)  for  each  t  >  0}. 

The  second  version  of  the  renewal  theorem  is  due  to  Feller.  Rather  than 
require  F  to  be  spread-out,  it  is  demanded  only  that  F  be  non-arithmetic 
(i.e.  there  exists  no  positive  number  r)  such  that  all  the  points  of  increase 
of  F  appears  in  the  set  {kr)  :  k  >  0}).  On  the  other  hand,  the  conditions 
on  6  are  now  strengthened  somewhat.  Let 

^„(4,  h)  =  sup{4(«) :  nA  <  fi  <  (n  1)A} 

2^(6,  h)  =  inf{6(s)  :nh<a<{n+  1)A}. 

The  function  b  is  said  to  be  directly  Rieman  integrable  (d.R.i.)  if 
21^=0  A)  <  oo  for  all  A  >  0  and  if 

CO 

IjmA  ■  ^(F„(4,A)  -2„(6,A))  =  0. 

n=0 

Note  that  every  directly  Riemann  integrable  function  b  is  necessarily  bound¬ 
ed,  Lebesgue  integrable  over  [0,  oo),  and  convergent  to  zero  at  infinity. 

(2.10)  Theorem.  Suppose  that  F  €  F  and  is  non-aurithmetic.  If  6  is  d.R.i., 
then  {Up  *  6)(t)  ^  A  b{s)ds  as  t  ^  oo. 

For  a  proof,  see  Feller  (1970).  With  this  strong  hypothesis  on  6,  it  is  well 
known  that  the  non-arithmetic  hypothesis  on  F  is  necessary  and  sufficient 
for  (Up  *  b)(t)  to  converge  to  A  6(s)<is.  By  this,  we  mean  that  if  A  >  0, 
then  it  is  necessary  and  sufficient  that  F  be  non-au^ithmetic  in  order  that 
(Up  *  6)(t)  — ►  A  b(s)ds  for  all  d.R.i.  b.  (For  the  necessity,  note  that  if 
F  is  arithmetic  with  spam  rj  and  b(t)  =  1(0  <  t  <  7/2),  then  (Up  *  b)(t)  = 
Up(t)  —  Up(t  —  7/2),  so  that  (Up  *  b)(nr])  — ►  A7  by  the  discrete  renewal 
theorem,  whereas  (Up  *  b)(nj)  +  ^7)  — »  0  as  n  — ►  00.) 


3.  LIMIT  THEOREMS  FOR  EQUILIBRIUM  PROCESSES 

Our  objective  here  is  to  discuss  the  implications  for  equilibrium  processes 
of  the  renewal  theorems  stated  in  Section  2.  An  equilibrium  process  is  a 
generalization  of  regenerative  process  that  was  introduced  by  Smith  (1955). 
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Specifically,  let  X  =  (X(/)  :  <  >  0)  be  a  (measurable)  S-valued  stochastic 
process.  Given  an  increasing  sequence  of  random  times  0  <  T'(O)  <  T(l)  < 

. . set  T(-l)  =  0  and  let  X(<)  =  max{n  >  —1  ;  T(n)  <  i}.  Put  X(i)  = 
(X(t),t  —  T(N(t))).  X  is  said  to  be  an  equilibrium  process  (with  respect 
to  (T(n)  :  n  >  0))  if: 

(3.1)  i)  (X(T(n)  +  t)  :t>  0)i(X(7'(0)  + 1)  :  t  >  0)  for  n  >  0  (i  denotes 
equality  in  distribution). 

ii)  T(n)  is  independent  of  (X(T(n)  + 1)  :  1  >  0)  for  n  >  0. 

X  is  a  uon-delayed  equilibrium  process  if  T(0)  =  0  and  is  otherwise  said 
to  be  delayed.  Note  that  we  do  not  demand  that  (X(t)  :  t  <  T(n))  be 
independent  of  (X(<)  :  i  >  T(n)),  as  would  be  the  case  for  a  regenerative 
process. 

The  principal  application  to  equilibrium  processes  of  renewal  methods 
involves  the  study  of  the  long-run  behavior  of  the  system.  Specifically,  let 
dtX  =  (X (t  +  s)  :  s  >  0)  and  let  /  be  a  real-valued  (suitably  meeeurable) 
function.  We  will  discuss  the  asymptotic  behavior  of  Ef{6tX)\  of  course, 
Ef{X{t))  is  but  a  special  case  of  this. 

Let  r.  =  T(i)  -  T{i  -  1)  for  i  >  0.  Set  a/(/)  =  Ef{B,X),  bf(t)  = 
£^{/(^T(0)+.^V);r,  >  t},  Cf{t)  =  E{/(^,X);ro  >  t),  G(0  =  P{ro  <  t)  and 
F(t)  =  P{ti  <  <}.  Finally,  put  Vi(f)  =  sup{/(0,X)  :  T(i  -!)<<<  T{i)} 
and  Yi(f)  =  f{e,X)ds  for  i  >  0. 

(3.2)  Proposition,  i)  Suppose  that  EVo(|/|)  <  oo  and  EV\{\f\)  <  oo. 
Then,  for  all  t  >  0,  <»/(<)  is  finited-valued  and  satisfies,  for  all  <  >  0, 

(3.3)  a^(<)  =  c/(()-(-(G*(/F*6;)(t). 

ii)  Suppose  that  EYbd/l)  <  £^^i(l/l)  <  oo-  Then,  for  a.e.  t  >  0  (a.e. 

with  respect  to  Lebesgue  measure),  aj{t)  is  finite-vedued.  Furthermore,  a/ 
satisfies  (3.3)  at  a.e.  t  >0. 

Proof,  A  standard  argument  shows  that  when  /  is  bounded,  (3.3)  holds. 
(Theorem  2.2  can  be  applied  directly  in  this  case.)  An  easy  approximation 
argument  then  shows  that  (3.3)  holds  for  all  non-negative  /.  To  extend 
to  the  case  where  /  is  unbounded  and  of  mixed  sign,  we  use  another  ap¬ 
proximation  argument  to  show  that  (3.3)  holds  at  each  t  >  0  for  which 
a|/|(«)  <  00.  For  i),  note  that  C|y|(t)  <  £Vo(l/l),  6|;|(t)  <  EVi{\f\),  and 
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it  follows  that  a|/|(0  <  £Vo(l/l)  +  Up(i)  ■  EVi{\f\)  <  oo.  For  ii),  observe 
that  /q°°  C|/i(s)(is  =  E^Yod/l),  /Q“6|yj(s)ds  =  fjyi(|/l),  and  it  follows  that 
Jo  0u]is)d8  <  EYo(\f\)  +  Urit)  •  EY^m  <  oo  for  all  t  >  0. 

Note  that  the  convolution  Up  *bj  appears  in  (3.3),  thereby  suggesting 
that  the  renewal  theorem  will  play  a  central  role  in  the  analysis  of  the 
asymptotic  behavior  of  a/(<).  The  following  theorem  is  the  translation  of 
Theorem  2.9  to  our  current  setting.  (Observe  that  Fubini’s  theorem  implies 
that/“fc/(<)d<  =  £:yi(/).) 

(3.4)  Theorem.  Suppose  that  F  ^  T  and  is  spread-out.  If  £(Vo(lffl)  + 
Vi(!tf|)  +  y:(|y|))<oo,then 

lim  sup  |£/(fl»X)  —  AEyi(/))  =  0. 

Proof.  The  proof  is  basically  a  consequence  of  Theorem  2.9.  Note  that 
E^o(\g\)  <  00  implies  that  c/(t)  — ►  0  uniformly  in  /  satisfying  |/|  <  |j|. 
To  handle  G  *  Up  *  b/,  we  apply  a  slight  extension  of  Theorem  2.9,  stated 
as  Theorem  1  of  Arjas,  Nummelin,  and  Tweedie  (1978). 

In  terms  of  the  hypotheses  that  enter  Theorem  3.4,  the  moment  con¬ 
ditions  on  Vo(|p()  and  Vidal)  might,  at  first  glance,  seem  unnecessary. 
They  are  basically  imposed  in  order  to  guarantee  that  C|,|(<)  and  6|,|(t) 
be  bounded  functions  that  vanish  at  infinity.  As  pointed  out  in  Examples 
2.7  and  2.8,  some  condition  of  this  kind  is  necessary. 

Suppose  that  Er^  <  oo  and  let  ir(-)  be  the  probability  distribution  on 
S  defined  by  t(  )  =  XE{J^^^^  I{X(8)  €  Ods).  An  important  corollary  to 
Theorem  3.4  is  that  if  F  is  spread-out,  then  P{X(t)  6  •}  converges  to  t(  ) 
in  total  variation  norm. 

(3.5)  Corollary.  Suppose  that  F  €  F  and  is  spread-out.  If  Eti  <  oo, 
then 

||P{X(0  e  •}  -  x(  )ll  ^  0  as  t  -  oo. 
where  ||»7(  )||=  8up{|r7(j4)(;  A  is  Borel  measurable}. 

Miller  (1972)  points  out  that,  in  some  sense,  the  requirement  that  F  be 
spread-out  is  necessary.  Suppose  that  £  €  £  has  finite  mean  and  yet  is  not 
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spread-out.  For  such  an  F,  Miller  showed  that  there  exists  a  real-valued 
regenerative  process  X  for  which  ti  has  distribution  F  and  yet  A’(<)  does 
not  even  converge  in  distribution  as  <  — *  oo.  Thus,  in  order  to  weaken  the 
requirement  on  F  to  an  assumptk  n  that  F  is  non-arithmetic,  it  is  necessary 
to  include  a  hypothesis  on  X. 

Suppose  that  S  is  a  metric  space.  Let  Ds[0,  oo)  be  the  Skorohod  space  of 
right-continuous  functions  x  :  [0,oo)  — »  S  having  left  hmits  at  every  t  >  0. 
The  hypothesis  on  X  involves  assuming  that  X  has  paths  in  DslO.oo).  The 
next  result  is  basically  Miller’s  extension  of  Feller’s  version  of  the  renewal 
theorem  to  the  equilibrium  process  setting. 

(3.6)  Theorem.  Suppose  that  F  €  f  is  non-arithmetic  and  has  finite 
mean.  If  S  is  a  metric  space  and  A'  €  Ds(0,oo),  then  P{X(t)  e  )  =>  7r(  ) 
as  t  — *  oo.  (=>  denotes  weak  convergence). 

Proof.  This  result  was  established  by  Miller  (1972)  in  the  special  case 
that  5  =  F?  (this  argument  is  stated  in  terms  of  regenerative  processes  but 
easily  extends  to  equilibrium  processes).  To  extend  to  the  general  case,  let 
/  :  5  — *  IR  be  a  continuous  map.  Then,  (/(A'(<))  :  t  >  0)  is  an  equilibrium 
process  having  paths  in  D«[0,  oo).  We  can  now  apply  Theorem  3.1  of  Miller 
(1972)  to  conclude  that  f{X(t))  =»  /(A(oo))  as  <  —  oo,  where  A(oc)  has 
distribution  x.  It  follows  from  Theorem  5.2  ii)  of  Billingsley  (1968)  that 
X(t)  =>  A'(oo)  as  t  —  oo. 

We  note  that  Theorem  3.6,  in  contrast  to  Corollary  3.5,  requires  topo¬ 
logical  assumptions  on  5  and  path  regularity  of  A'.  Furthermore,  the  total 
vewiation  convergence  of  Corollary  3.5  is  much  stronger  than  the  weak  con¬ 
vergence  of  Theorem  3.6.  In  addition,  note  that  Theorem  3.6  permits  us 
only  to  assert  that  Ef{X{i))  — *  Ef{X{oo))  for  all  bounded  continuous  /; 
if  /  is  either  unbounded  or  discontinuous.  Theorem  3.6  offers  no  conclusion, 
in  contrast  to  Theorem  3.4.  On  the  other  hand,  the  non-arithmetic  assump¬ 
tion  on  T\  is  considerably  weaker  than  the  demand  that  t\  be  spread-out, 
as  appeared  in  Theorem  3.4  and  Corollary  3.5.  Thus,  bc*h  the  Smith  and 
Feller  versions  described  above  are  somewhat  unsatisfactory. 
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4.  A  SMOOTHED  VERSION  OF  THE  RENEWAL 
THEOREM 


In  Sections  4  and  5,  we  state  and  prove  the  main  results  of  this  paper. 
We  start  in  this  section  by  describing  a  smoothed  variant  of  the  renewal 
theorem.  This  theorem  will  basically  establish  “smoothed  convergence”  of 
{Uf  *  (>)(t)  to  A  /q°°  i(s)ds  under  the  weakest  possible  conditions,  namely 
integrability  of  6  over  [0,  oo)  and  non-arithmeticity  of  F. 

Let  K  be  an  absolutely  continuous  distribution  in  T  which  has  a  Lebesgue 
density  k  with  support  contained  in  [0,7^(0  <  T  <  oo);  we  further  require 
that  k  be  continuous  on  [0,7^.  We  will  use  K  to  smooth  out  the  solution 
a  =  Up  *  b  to  the  renewal  equation.  Specifically,  we  will  consider  the 
quantity  {A'*a)(t)=  k{s)a{t  —  s)ds  ast  —  oo.  Thus,  K  is  used  to  smooth 
the  solution  a  in  the  region  [(  —  T,t].  Since  convolution  with  K  ought  to 
enhance  the  regularity  of  a,  we  expect  that  some  of  the  pathologies  which 
we  discussed  in  Section  2  will  cease  to  be  a  jroblem.  The  next  theorem  is 
an  illustration  of  this  point  (compare  with  Theorem  2.9). 

(4.1)  Theorem.  Suppose  that  F  ^  T  non-arithmetic.  If  c  is  a  non¬ 
negative  Lebesgue  integrable  function  on  (0,oo),  then 

lim  sup  1(A'  *  Up  *  b)(i)  —  A  /"  6(s)dsl  =  0. 

*-'*’|61<c  Jo 


Proof.  First  we  extend  b  and  k  to  (— oc.cc)  by  setting  b(t)  =  k(t)  =  0 
for  i  <  0.  Let  Up(i)  =  Fp(t)  —  M  and  ^i{t)  —  [K  *  b){t}.  Observe  that 
K  *  Up  =  Up  •  K  and  ‘fi{s)ds  =  /J*  b{s)ds  for  b  integrable.  Hence, 


(4.2) 


sup  KA"  *  Up  *  6)(t)  —  A 

1*1  <C 

=  8UP  ^ 

l*l<c 

<  sup  l(L^r*^»)(OI  +  '^ 
l*l<c 


6(s)ds| 

ific[s)d»- 


Since  (fic  is  integrable  over  [0,oo).  the  second  term  tends  to  tero  as  <  — ► 
oo.  For  the  first  term,  we  approximate  fi,  by  a  suitably  chosen  piecewise 
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constant  function  Set  for  /»  >  0  and  write  = 

t/>  *  +  Up  *  (<fib  -  Let  i  =  [t/hl  and  r  =  <  -  h[t/h\  It  may  be 

verified  that 

{Up  *  <Pi)(t)  =  <Pb(^fi)  ■  Up(r)+ 

(4  3)  ^  ^  ^  (Up(r  +  (i  +  l)h)  -  Up(r  +  »/»)). 

1  =  0 


It  follows  that 

sup  j(Up  *  v»d)(01  <  ¥’f(fiL*/^J)(L^/’(^)  + 

(4.4)  <-i 

+  ^i^c(j/j)|LXt  -  jh)  -  Up(i  -  (j  +  l)/»)  -  Ahj. 

j  =  0 

For  the  first  term  on  the  right-hand  side  of  (4.4),  we  note  that  <Pe{i)  = 
/g  c(s)k(i  -  s)ds  —  0  by  the  bounded  convergence  theorem  (k  is  bounded 
because  of  continuity  over  its  support).  So  the  first  term  vanishes  as  /  — *  oo. 
To  deal  with  the  second  term,  recall  that  Up(t- jh)-Up{t-(j+l)h)  —  Xh 
as  t  .  oc  by  Blackwell’s  theorem  (Feller  (1970),  p.  360).  Furthermore, 
these  differences  are  bounded  uniformly  in  t  and  j.  Hence,  the  second  term 
in  (4.4)  vanishes  as  f  — •  oo,  provided  that  we  show  V’c(jfi)  < 

To  prove  this,  let  M  =  sup{|/t(s)l  :  0  <  s  <  T)  and  let  e{h)  =  sup{|I:(f)  - 
k(t- h)i  :  h  <t  <T}.  Note  that  e{h)  (  0  as  A  j  0  by  uniform  continuity  of 
k.  For  |6|  <  c  and  0  <  <'  =  h[l/h\  <  f, 

/•« 

\Mi)  -  Mt')\  =  \  k{t-s)b(s)ds-  k(t' -  s)b{s)ds\ 

Jt-T  Jt'-T 

<  f  k{t  -  8)\b(8)\ds  +  f  \k{t  -  8)  ~  k{t'  -  S)\\b{s)\d8 
Jr  Jt-T 

ft-T 

/  k{t'  -  s)|6(s)lds 

Jr-T 

ft  fT 

<M  c{s)d8+  |i(u)-<r(u-f-l-<')k(f-u)du 

Jt-h  A 
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+  f  k(u)c(t  —  u)du  +  f  k{u  —  t  +  t')c(t  —  u)du 

Jt-t'  Jt-t' 

,t~T 

+  M  /  c(s)ds 
Jt-T-h 

<m(  f  c(s)ds  +  2  f  c{s)d8  +  f  c(s)ds) 
\Jt-h  Jt-h  Jt-T-h  J 

+  e(/i)  f  c{s)ds 
Jt-T 


Since  Jl_^c(s)ds  is  a  Lebesgue  integrable  function  of  1  over  [0,oo)  for 
any  finite  a,  it  is  evident  from  (4.3)  that 

jx:  -oo 

j=0  -'0 

/•OO  aOO 

<  /  ‘Pc(t)dt+  /  |v?c{t)  - 

Jo  Jo 

To  complete  the  proof  of  the  theorem,  it  is  sufficient  to  prove  that 
lim,-^  sup|(,|<j  \{U'p  *  (v?6  -  )){0I  =  0{h),  with  S(h)  |  0  as  h  ]  0.  It  is 

easily  seen  that  (4.5)  proves  that  |^j(<)  —  v’tlOl  <  where 

Ifhlk+O)  fhlk+D-T  rh(k+\) 

3  /  c(s)ds  +  /  c(s)ds  +  e(h)  /  c(s)ds 

Jh(k-D  Jh(^k-l)-T  Jhk-T 

and  Vh(0  =  }ph(h\t/h\).  A  routine  cadculation  shows  that  rph(t)  —  0  as 
t  —  00  and  that  \ll^^{^)dt  =  y{h),  with  7(A)  f  0  as  A  i  0.  Now, 

(4.6)  sup  *  (<,f>6  -  Sf’?))(OI  <  /  {Ur(ds)  +  Xds)xph(t  -  s). 
l»|<c 

Using  the  piecewise-constant  structure  of  V’hi  we  can  argue,  as  we  did  for 
(4.3),  that 


(Uf  krl>h)it)<i>h{h[.t/h\)UF{h) 

+  J2  M}h){UF{t-jh)-UF{t-{j-l)h)). 
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Again,  Blackwell’s  theorem  asserts  that  t/f(l  —  jh)  -  Urit  —  (j  -  l)/>)  — ► 
A/i  as  <  — >  oo.  Using  the  aforementioned  properties  of  V'h,  we  find  that 
lim,_oo(f^F  ♦  S  ^  t/'h(8)ds.  It  follows  from  (4.6)  that 

lim,_oo  sup  Kt/;.  *  (<^4  -  v’?))(OI  <  2A7(/i), 

l»l<e 

completing  the  proof. 

The  following  “averaging”  result  is  an  immediate  consequence  of  Theorem 
4.1. 

(4.7)  Corollary.  Suppose  that  F  €  is  non-arithmetic  and  b  is  Lebesgue 
integrable  on  [0,oc).  Then,  for  /t  >  0, 

—  /  (Up  *  b)(s)ds X  f  b{s)ds  as  <  — ♦  oo. 
h  Jt-h  Jo 

A  noteworthy  feature  of  this  result  is  that  it  holds  for  any  positive  h. 
Thus,  if  the  solution  Up*b  is  averaged  in  an  arbitrarily  small  neighborhood 
of  t,  it  behaves  nicely. 


5.  SMOOTHED  LIMIT  THEOREMS  FOR  EQUILIBRIUM 

PROCESSES 

In  this  section,  we  apply  Theorem  4.1  to  equilibrium  processes.  Our  first 
result  is  obtained  by  combining  Proposition  3.2  and  Theorem  4.1. 

(5.1)  Theorem.  Suppose  that  F  €  F"  is  non-arithmetic  and  F(Vo(|^|)  -f 
^i(IS'l))  <  ^  Assume  G  has  a  Lebesgue  density  with  support  contained  in 
[0,  T](T  <  oo).  If  the  density  is  continuous  on  [0,7^,  then 

lim  sup  \Ef{6,X)  -  AEyi(/)|  =  0. 
l/(<l»l 

Proof.  This  result  follows  immediately  from  Proposition  3.2  and  Theo¬ 
rem  4.1,  upon  showing  that  c/(<)  converges  to  zero  uniformly  in  /.  (Actu¬ 
ally,  Proposition  3.2  does  not  strictly  apply  here;  the  proof  can  be  modified 
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to  show  that  (3.3)  holds  at  all  t  >  0,  however.)  But  |c/(<)|  <  Cg(t)  < 
E{Voi\9\y,To>i}-*0. 

Total  variation  convergence  is  an  easy  corollary  of  Theorem  5.1. 

(5.2)  Corollary.  Suppose  that  F  €  .^  is  non-arithmetic  with  finite  mean. 
Assume  G  satisfies  the  conditions  of  Theorem  5.1.  If  tt  is  defined  as  in 
Section  3,  then 


||P{A:(t)£  }  -  *-(  )ll  —  0  as  t  —  oo. 

The  interesting  point  here  is  that  the  “delay  cycle”  can  smooth  the  equi¬ 
librium  process  enough  to  obtain  total  variation  convergence.  Recall,  from 
Section  3,  that  Miller’s  example  shows  that,  without  the  smoothing  of  the 
delay  cycle,  we  can  not  even  expect  convergence  in  distribution  (without 
making  further  assumptions  about  the  paths  of  X). 

The  results  of  Section  4  can  also  be  used  to  obtain  smoothed  limit  theo¬ 
rems  that  are  more  reminiscent  of  Corollary  4.7. 

(5.3)  Theorem.  Suppose  that  F  6  F  is  non-arithmetic  and  F(yb(l5l)  + 
^iduD)  <  00.  If  X  is  as  described  in  Section  4,  then 

lim  sup  \f  k{s)Efie,..X)ds- XEYi(f)\  =  0. 

Jo 


Proof.  To  prove  this  result,  we  note  that  k(s)Ef{0t-,X)ds  = 
{K*cj){t)  +  {G*K*U!*b!){t)  {or  t>T.  Since  {K *Ur*bj){t)  -  XEY^if) 
uniformly  in  /  (and  can  be  bounded  uniformly  in  both  /  and  t),  the 
bounded  convergence  theorem  shows  that  {G  *  K  *Uf  *  6/)(0  — ‘  XEY\{f) 
uniformly  in /.  For  the  other  term  observe  that  |(X*c/)(t)|  <  (A'*C|j|)(t)  < 
Af //_7- C|/|(«)ds  — ►  0.  Here,  M  is  a  bound  on  k  and  we  use  the  fact  that 
^^odyl)  <  00  to  conclude  that  C|^|  is  integrable  on  [0,oo)  (This  implies 
il-T  -*  0  ) 

Again,  we  can  write  down  a  total  variation  convergence  corollary  to  this 
result;  it  is  the  equilibrium  process  analog  of  the  averaging  result  given  by 
Corollary  ^.1. 
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(5.4)  Corollary.  Suppose  that  F  €  /”  is  non-arithmetic  with  finite 
mean.  Let  w  be  defined  as  in  Section  3.  Then  for  any  h  >  0, 

^  P{X{s)e  ]ds  -  ;r(  )l|  0  as  1  oo. 

A  common  feature  of  the  smoothed  limit  theorems  of  this  section  is  that 
convergence  is  proved  under  minimal  hypotheses.  In  addition  to  its  math- 
ematiced  virtues,  this  should  make  hypothesis  validation  easier  from  an 
applications  viewpoint.  Furthermore,  it  is  our  opinion  that  these  smoothed 
versions  provide  information  that  is,  from  a  practical  perspective,  essen- 
ti^Jly  equivalent  to  that  obtained  from  an  unsmoothed  version. 
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